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SIGNAL PROCESSING SYSTEM 
The present invention relates to a signal processing 
method and apparatus. The invention is particularly 
relevant to a statistical analysis of signals output by 
5 a plurality of sensors in response to signals generated 

by a plurality of sources. The invention may be used in 
speech applications and in other applications to process 
the received signals in order to separate the signals 
generated by the plurality of sources. The invention can' 
10 also be used to identify the number of sources that are 

present . 



There exists a need to be able to process signals output 
by a plurality of sensors in response to signals 
generated by a plurality of sources. The sources may, 
for example, be different users speaking and the sensors 
may be microphones. Current techniques employ arrays of 
microphones and an adaptive beam forming technique in 
order to isolate the speech from one of the speakers. 
This kind of beam forming system suffers from a number of 
problems. Firstly, it can only isolate signals from 
sources that are spatially distinct. It also does not 
work if the sources are relatively close together since 
the "beam" which it uses has a finite resolution. It is 
also necessary to know the directions from which the 
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signals of interest will arrive and also the spacing 
between the sensors in the sensor array. Further, if N 
sensors are available, then only N - 1 "nulls" can be 
created within the sensing zone. 

An aim of the present invention is to provide an 
alternative technique for processing the signals output 
from a plurality of sensors in response to signals 
received from a plurality of sources.. 



According to one aspect, the present invention provides 
a signal processing apparatus comprising s one or more 
receivers for receiving a set of signal values 
representative of signals generated by a plurality of 

15 signal sources; a memory for storing a probability 

density function for parameters of a respective signal 
model, each of which is assumed to have generated a 
respective one of the signals represented by the received 
signal values; means for applying the received signal 

2 0 values to the probability density function; means for 

processing the probability density function with those 
values applied to derive samples of parameter values from 
the probability density function; and means for analysing 
some of the derived samples to determine parameter values 

25 that are representative of the signals generated by at 



least, one of -the sources . 



Exemplary embodiments of the present invention will now 
be described with reference to the accompanying drawings 
in which: 

Figure 1 is a schematic view of a computer which may be 
programmed to operate in accordance with an embodiment of 
the present invention; 

Figure 2 is a block diagram illustrating the principal 
components of a speech recognition system; 

Figure 3 is a block diagram representing a model employed 
by a statistical analysis unit which forms part of the 
speech recognition system shown in Figure 2; 

Figure 4 is a flow chart illustrating the processing 
steps performed by a model order selection unit forming 
part of the statistical analysis unit shown in Figure 2; 

Figure 5 is a flow chart illustrating the main processing 
steps employed by a Simulation Smoother which forms part 
of the statistical analysis unit shown in Figure 2; 
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Figure 6 is a block diagram illustrating the main 
processing components of the statistical analysis unit 
shown in Figure 2 ? 

Figure 7 is a memory map illustrating the data that is 
stored in a memory which forms part of the statistical 
analysis unit shown in Figure 2; 



Figure 8 is a flow chart illustrating the main processing 
10 steps performed by the statistical analysis unit shown in 

Figure 6 ; 

Figure 9a is a histogram for a model order of an auto 
regressive filter model which forms part of the model 
15 shown in Figure 3; 

Figure 9b is a histogram for the variance of process 
noise modelled by the model shown in Figure 3; 

20 Figure 9c is a histogram for a third coefficient of the 

AR filter model; 
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Figure 10 is a block diagram illustrating the principal 
components of a speech recognition system embodying the 
present invention ; 



Figure 11 is a block diagram representing a model 
employed by a statistical analysis unit which forms part 
of the speech recognition system shown in Figure 10; 

Figure 12 is block diagram illustrating the principal 
components of a speech recognition system embodying the 
present invention; 



Figure 13 is a flow chart illustrating the main 
processing steps performed by the statistical analysis 
units used in the speech recognition system shown in 
Figure 12; 

Figure 14 is a flow chart illustrating the processing 
steps performed by a model comparison unit forming part 
of the system shown in Figure 12 during the processing of 
a frame of speech by the statistical analysis units shown 
in Figure 12; 

Figure 15 is a flow chart illustrating the processing 
steps performed by the model comparison unit shown in 
Figure 12 after a sampling routine performed by the 
statistical analysis unit shown in Figure 12 has been 
completed; 
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Figure 16 is a block diagram illustrating the main 
components of an alternative speech recognition system in 
which data output by the statistical analysis unit is 
used to detect the beginning and end of speech within the 
5 input signal; 

Figure 17 is a schematic block diagram illustrating the 
principal components of a speaker verification system; 

10 Figure 18 is a schematic block diagram illustrating the 

principal components of an acoustic classification 
system; 



Figure 19 is a schematic block diagram illustrating the 
15 principal components of a speech encoding and 

transmission; and 

Figure 20 is a block diagram illustrating the principal 
components of a data file annotation system which uses 
20 the statistical analysis unit shown in Figure 6 to 

provide quality of speech data for an associated 
annotation . 



25 



Embodiments of the present invention can be implemented 
on computer hardware, but the embodiment to be described 



is implemented in software which is run in conjunction 
with processing hardware such as a personal computer, 
workstation, photocopier, facsimile machine or the like. 

Figure 1 is a personal computer (PC) 1 which may be 
programmed to operate an embodiment of the present 
invention. A keyboard 3, a pointing device 5, two 
microphones 7-1 and 7-2 and a telephone-line 9 are 
connected to the PC 1 via an interface 11. A keyboard 3 
and pointing device 5 allow the system to be controlled 
by a user. The microphones 7 convert the acoustic speech 
signal of one or more users into equivalent electrical 
signals and supplies them to the PC 1 for processing. An 
internal modem and speech receiving circuit (not shown) 
may be connected to the telephone line 9 so that the PC 
1 can communicate with, for example, a remote computer or 
with a remote user. 

The program instructions which make the PC 1 operate in 
accordance with the present invention may be supplied for 
use with an existing PC 1 on, for example, a storage 
device such as a magnetic disc 13, or by downloading the 
software from the Internet (not shown) via the internal 
modem and telephone line 9 . 
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The operation of a speech recognition system which 
receives signals output from multiple microphones in 
response to speech signals generated from a plurality of 
speakers will be described • However, in order to 
facilitate the understanding of the operation of such a 
recognition system, a speech recognition system which 
performs a similar analysis of the signals output from 
the microphone for the case of a single speaker and 
single microphone will be described first with reference 
to Figure 7 to 9 ? 

SINGLE SPEAKER SINGLE MICROPHONE 

As shown in Figure 2, electrical signals representative 
of the input speech from the microphone 7 are input to a 
filter 15 which removes unwanted frequencies (in this 
embodiment frequencies above 8 kHz) within the input 
signal • The filtered signal is then sampled (at a rate 
of 16 kHz) and digitised by the analogue to digital 
converter 17 and the digitised speech samples are then 
stored in a buffer 19. Sequential blocks (or frames) of 
speech samples are then passed from the buffer 19 to a 
statistical analysis unit 21 which performs a statistical 
analysis of each frame of speech samples in sequence to 
determine, amongst other things, a set of auto regressive 
(AR) coefficients representative of the speech within the 



frame. In this embodiment, the AR coefficients output by 
the statistical analysis unit 21 are then input, via a 
coefficient converter 23 to a cepstral based speech 
recognition unit 25. In this embodiment, therefore, the 
coefficient converter 23 converts the AR coefficients 
output by the analysis unit 21 into cepstral 
coefficients. This can be achieved using the conversion 
technique described in, for example, "Fundamentals of 
Speech Recognition" by Rabiner and Juang at pages 115 and 
116. The speech recognition unit 25 then compares the 
cepstral coefficients for successive frames of speech 
with a set of stored speech models 27, which may be 
template based or Hidden Markov Model based, to generate 
a recognition result. 

Statistical Analysis Unit - Theory and Overview 

As mentioned above, the statistical analysis unit 21 
analyses the speech within successive frames of the input 
speech signal. in most speech processing systems, the 
frames are overlapping. However, in this embodiment, the 
frames of speech are non-overlapping and have a duration 
of 2 0ms which, with the 16kHz sampling rate of the 
analogue to digital converter 17, results in a frame size 
of 320 samples. 
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In order to perform the statistical analysis on each of 
the frames, the analysis unit 21 assumes that there is an 
underlying process which generated each sample within the 
frame o The model of this process used in this embodiment 
is shown in Figure 3. As shown, the process is modelled 
by a speech source 31 which generates, at time t = n, a 
raw speech sample s(n). Since there are physical 
constraints on the movement of the speech articulators, 
there is some correlation between neighbouring speech 
samples. Therefore, in this embodiment, the speech 
source 31 is modelled by an auto regressive (AR) process,, 
In other words, the statistical analysis unit 21 assumes 
that a current raw speech sample (s(n)) can be determined 
from a linear weighted combination of the most recent 
previous raw speech samples, i.e.s 

s(ri) = a x s(n-\) + a 2 s(n-2) + + a k s(n-k) + e(n) (1) 

where a w a 2 a k are the AR filter coefficients 

representing the amount of correlation between the speech 
samples; k is the AR filter model order; and e(n) 
represents random process noise which is involved in the 
generation of the raw speech samples. As those skilled in 
the art of speech processing will appreciate, these AR 
filter coefficients are the same coefficients that the 



linear prediction (LP) analysis estimates albeit using a 
different processing technique. 

As shown in Figure 3, the raw speech samples s(n) 
generated by the speech source are input to a channel 33 
which models the acoustic environment between the speech 
source 31 and the output of the analogue to digital 
converter 17. Ideally , the channel 33 should simply 
attenuate the speech as it travels from the source 31 to 
the microphone 7. However , due to reverberation and 
other distortive effects , the signal (y(n)) output by the 
analogue to digital converter 17 will depend not only on 
the current raw speech sample (s(n)) but it will also 
depend upon previous raw speech samples. Therefore , in 
this embodiment, the statistical analysis unit 21 models 
the channel 33 by a moving average (MA) filter , i.e.: 

y( n ) = h 0 s(n) + h x s(n-l) + h 2 s(n-2) + + h r s(n-r) + z(ri) (2) 

where y(n) represents the signal sample output by the 
analogue to digital converter 17 at time t = n; h 0/ h lf 
h 2 ....h r are the channel filter coefficients representing 
the amount of distortion within the channel 33; r is the 
channel filter model order; and £(n) represents a random 
additive measurement noise component. 
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For the current frame of speech being processed , the 
filter coefficients for both the speech source and the 
channel are assumed to be constant but unknown. 
Therefore, considering all N samples (where N = 320) in 
5 the current frame being processed gives s 
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15 



20 



s(n) = a x s(n-\) + a 2 s(n-2) + + a k s(n-k) + e(ri) 

s(n-\) = a x s(n~2) + a 2 s(n-3) + + a k s{n-k-\) + e(n-\) 



(3) 



s(n-N+l) = a x s{n-N) + a 2 s(n-N-l) + + a k s(n-k-N+\) + e(n-N+l) 

which can be written in vector form as s 

s.(n) = S. a + e.(ri) 

where 



and 



s(n-l) s(n-2) s(n-3) 
s{n -2) s(n-3) s(n-4) 
s(n~3) s(n-4) s(n-5) 



s(n-N) s(n-N~l) s(n-N-2) 



s(n-k) 
s(n-k-l) 
s(n-k-2) 



s(n-k-N+l) 



J Nxk 



(4) 
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s(n) 
s(n-l) 
s(n-2) 



e(n) 
e(n-2) 



As will be apparent from the following discussion, it is 
also convenient to rewrite equation (3) in terms of the 
random error component (often referred to as the 
residual) e(n) . This gives: 

e(n) = s(n) - a x s(n-l) - a 2 s(n-2) - - a k s(n-k) 

e(n-l) = s(n-l) - a x s(n-2) - a 2 s(n-3) - - a k s(n-k-\) 

(5) 



e(n-N+l) = s(n-N+l) - a x s(n-N) - a 2 s(n-N-\) - - a k s(n-k-N+\) 

which can be written in vector notation as : 

zip) = As_{ri) (6) 

where 



A = 



1 




~ a 2 


-a 3 . . 


■ ~ a k 


0 


0 0 . 


. o' 


0 


1 




-a 2 . . 






0 0 . 


. 0 


0 


0 


1 


-a x . . 


■ ~ a ,c-2 


-°k-\ 


-a k 0 


. 0 



NxN 



Similarly, considering the channel model defined by 
equation (2), with h 0 = 1 (since this provides a more 
stable solution), gives: 

q (n) = h x s (n - 1 ) + h 2 s (n -2) + .. + h r s (n -r) + e (n) 
q(n-\) =h x s(n-2) + /i 2 jr(w-3) + .. + h r s(n-r-l) + e(«-l) 

(7) 



q(n-N+l) =h x s(n-N)+h 2 s(n-N-l) + .. + h r s (n-r-N+1) + e(«-iV + l) 
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(where q(n) = y(n) - s(n)) which can be written in vector 
form ass 

2(ri) = Y.h + £(«) 



(8) 



where 



Y = 



s(n-l) s(n-2) s(n-3) 
s(n-2) s(n-3) s(n-4) 
s(n-3) s(n-4) s(n-5) 



s(n-r) 
s{n-r-\) 
s(n-r-2) 



s(n-N) s(n-N-l) s(n-N-2) 



. s(n-r-N+l) 



Nxr 



and 



rxl 



q(rt-Y) 
q(n-2) 



Afr/ 



e(«-l) 
e(/i-2) 



e(n-N+l) 



In this embodiment, the analysis unit 21 aims to 
determine , amongst other things, values for the AR filter 
coefficients (a) which best represent the observed signal 
samples (y(n) ) in the current frame. It does this by 
determining the AR filter coefficients (a) that maximise 
the joint probability density function of the speech 
model, channel model, raw speech samples and the noise 
statistics given the observed signal samples output from 
the analogue to digital converter 17, i.e. by 
determining : 



15 



max 
a 



where a e 2 and o* represent the process and measurement 
5 noise statistics respectively. As those skilled in the 

art will appreciate , this function defines the 
probability that a particular speech model, channel 
model , raw speech samples and noise statistics generated 
the observed frame of speech samples (y(n)) from the 
10 analogue to digital converter. To do this, the 

statistical analysis unit 21 must determine what this 
function looks like. This problem can be simplified by 
rearranging this probability density function using Bayes 
law to give: 



15 



/>(y(*)|a(*)A,^o:)p(^ ( 1Q) 



As those skilled in the art will appreciate, the 
denominator of equation (10) can be ignored since the 
2 0 probability of the signals from the analogue to digital 

converter is constant for all choices of model. 
Therefore, the AR filter coefficients that maximise the 
function defined by equation (9) will also maximise the 
numerator of equation (10). 

25 
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Each of the terms on the numerator of equation (10) will 
now be considered in turn. 



10 



p(s(n) | a, k, a e 2 ) 

This term represents the joint probability density 
function for generating the vector of raw speech samples 
(s(n)) during a frame, given the AR filter coefficients 
(a), the AR filter model order (k) and the process noise 
statistics (a e 2 )„ From equation (6) above, this joint 
probability density function for the raw speech samples 
can be determined from the joint probability density 
function for the process noise « In particular p(s.(n) |a, 
k, a e 2 ) is given by: 



15 



P(s(n)\a 9 k 9 a 2 .) =p(e(n)) 



5fi(w) 



(11) 



20 



where p(e(n)) is the joint probability density function 
for the process noise during a frame of the input speech 
and the second term on the right-hand side is known as 
the Jacobean of the transformation. In this case, the 
Jacobean is unity because of the triangular form of the 
matrix A (see equations (6) above). 



25 



In this embodiment, the statistical analysis unit 21 
assumes that the process noise associated with the speech 
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source 31 is Gaussian having zero mean and some unknown 
variance a e 2 . The statistical analysis unit 21 also 
assumes that the process noise at one time point is 
independent of the process noise at another time point. 
Therefore, the joint probability density function for the 
process noise during a frame of the input speech (which 
defines the probability of any given vector of process 
noise e(n) occurring) is given by: 



10 



15 



p(eln)) = (2ko 2 £ ) 2 exp 



2at 



(12) 



Therefore , the joint probability density function for a 
vector of raw speech samples given the AR filter 
coefficients (a), the AR filter model order (k) and the 
process noise variance (o e 2 ) is given by: 



A' 



20 



25 



P(s&)\a 9 k,o e ) = (2na e ) 2 exp 



— (x(») r i(«) - 2a T S&(n) + a T S T S a ) 
2a: 



(13) 



P(X(n)\s(n), h, r, a/) 

This term represents the joint probability density 
function for generating the vector of speech samples 
(y;(n)) output from the analogue to digital converter 17, 
given the vector of raw speech samples (s(n)), the 
channel filter coefficients (h) , the channel filter model 
order (r) and the measurement noise statistics (a e 2 ). 
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From equation (8), this joint probability density 
function can be determined from the joint probability 
density function for the process noise., In particular, 
P(X(n)|s(n), h, r, a z 2 ) is given bys 

where p(e_(n)) is the joint probability density function 
for the measurement noise during a frame of the input 
speech and the second term on the right hand side is* the 
Jacobean of the transformation which again has a value of 
one o 

In this embodiment, the statistical analysis unit 21 
assumes that the measurement noise is Gaussian having 
zero mean and some unknown variance a £ 2 . It also assumes 
that the measurement noise at one time point is 
independent of the measurement noise at another time 
point. Therefore, the joint probability density function 
for the measurement noise in a frame of the input speech 
will have the same form as the process noise defined in 
equation ( 12 ) o Therefore, the joint probability density 
function for a vector of speech samples (y(n)) output 
from the analogue to digital converter 17, given the 
channel filter coefficients (h) , the channel filter model 



5£(tt) 

Sj<w) 



(14) 



order (r), the measurement noise statistics (o z 2 ) and the 
raw speech samples (s(n>) will have the following form: 



p(x(n)\&(n),k,r,o e ) = (27ta e ) 2 exp 



2a 



(15) 



As those skilled in the art will appreciate, although 
this joint probability density function for the vector of 
speech samples (Y( n )) i s in terms of the variable q(n), 
this does not matter since a(n) is a function of y(n) and 
s(n), and s(n) is a given variable (ie known) for this 
probability density function. 



P(*\k) 

This term defines the prior probability density function 
for the AR filter coefficients (a) and it allows the 
statistical analysis unit 21 to introduce knowledge about 
what values it expects these coefficients will take. In 
this embodiment, the statistical analysis unit 21 models 
this prior probability density function by a Gaussian 
having an unknown variance (a a 2 ) and mean vector (U a ) , 
i.e.: 

p(a\K<5 2 ay \i a ) = (27ia 2 a ) 2 exp 



2oj 



(16) 



By introducing the new variables a a 2 and y^ f the prior 
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density functions (p(cr a 2 ) and p(jUa)) for these variables 
must be added to the numerator of equation (10) above • 
Initially, for the first frame of speech being processed 
the mean vector (iu) can be set to zero and for the 
second and subsequent frames of speech being processed, 
it can be set to the mean vector obtained during the 
processing of the previous frame • In this case, p(jJa) is 
Just a Dirac delta function located at the current value 
of Ha and can therefore be ignored. 

With regard to the prior probability density function for 
the variance of the AR filter coefficients, the 
statistical analysis unit 21 could set this equal to some 
constant to imply that all variances are equally 
probable * However, this term can be used to introduce 
knowledge about what the variance of the AR filter 
coefficients is expected to be. In this embodiment, 
since variances are always positive, the statistical 
analysis unit 21 models this variance prior probability 
density function by an Inverse Gamma function having 
parameters a a and 3 a , i.e.: 



(o 2 y a ° * 1} 

P a r(a a) 



exp 



1 



(17) 
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At the beginning of the speech being processed, the 



21 

statistical analysis unit 21 will not have much knowledge 
about the variance of the AR filter coefficients. 
Therefore, initially / the statistical analysis unit 21 
sets the variance a a 2 and the oc and 3 parameters of the 
5 Inverse Gamma function to ensure that this probability 

density function is fairly flat and therefore non- 
informative. However, after the first frame of speech 
has been processed, these parameters can be set more 
accurately during the processing of the next frame of 
10 speech by using the parameter values calculated during 

the processing of the previous frame of speech. 

P(t\r) 

This term represents the prior probability density 
15 function for the channel model coefficients (h) and it 

allows the statistical analysis unit 21 to introduce 
knowledge about what values it expects these coefficients 
to take. As with the prior probability density function 
for the AR filter coefficients, in this embodiment, this 
20 probability density function is modelled by a Gaussian 

having an unknown variance (a h 2 ) and mean vector (£/ h ), 
i.e.: 

_N 

p(h\r y a 2 hi i h ) = (2kcI) 2 exp 

25 



2a,, 



(18) 
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Again, by introducing these new variables, the prior 
density functions (p(a h ) and p(^) ) must be added to the 
numerator of equation (10). Again, the mean vector can 
initially be set to zero and after the first frame of 
5 speech has been processed and for all subsequent frames 

of speech being processed, the mean vector can be set to 
equal the mean vector obtained during the processing of 
the previous frame. Therefore, p(]J h ) is also just a 
Dirac delta function located at the current value of jj^ 
10 and can be ignored. 

With regard to the prior probability density function for 
the variance of the channel filter coefficients, again, 
in this embodiment, this is modelled by an Inverse Gamma 
15 function having parameters a h and p h . Again, the variance 

(a h 2 ) and the a and p parameters of the Inverse Gamma 
function can be chosen initially so that these densities 
are non-informative so that they will have little effect 
on the subsequent processing of the initial frame. 

20 

p(a & 2 ) and p(o/) 

These terms are the prior probability density functions 
for the process and measurement noise variances and 
again, these allow the statistical analysis unit 21 to 
25 introduce knowledge about what values it expects these 



noise variances will take. As with the other variances, 
in this embodiment , the statistical analysis unit 21 
models these by an Inverse Gamma function having 
parameters a e , p e and a c , 3 2 respectively. Again, these 
variances and these Gamma function parameters can be set 
initially so that they are non-informative and will not 
appreciably affect the subsequent calculations for the 
initial frame. 



p(k) and p(r) 

These terms are the prior probability density functions 
for the AR filter model order (k) and the channel model 
order (r) respectively. In this embodiment, these are 
modelled by a uniform distribution up to some maximum 
order. In this way, there is no prior bias on the number 
of coefficients in the models except that they can not 
exceed these predefined maximums. In this embodiment, 
the maximum AR filter model order (k) is thirty and the 
maximum channel model order (r) is one hundred and fifty. 

Therefore, inserting the relevant equations into the 
numerator of equation (10) gives the following joint 
probability density function which is proportional to 
P(a,k,h,r,a a 2 ,a h 2 ,a e 2 ,c £ 2 ,s(n) |y(n) ) : 
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(19) 



Gibbs Sampler 

15 In order to determine the form of this joint probability 

density function, the statistical analysis unit 21 "draws 
samples" from it. In this embodiment, since the joint 
probability density function to be sampled is a complex 
multivariate function, a Gibbs sampler is used which 

20 breaks down the problem into one of drawing samples from 

probability density functions of smaller dimensionality. 
In particular, the Gibbs sampler proceeds by drawing 
random variates from conditional densities as follows: 
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first iteration 

p(a;|a^^^&^r^af,af,af,^)V(«)) af 

second iteration 

^(a^&V^o^of,cJ , J(/I) l l¥ (ll)) a 2 ,* 2 

etc . 

where <h\ r°, (o Q 2 ) 0 , (a, 2 ) 0 , (a, 2 ) 0 , (a h 2 )\ s(n)°) are 
initial values which may be obtained from the results of 
the statistical analysis of the previous frame of speech, 
or where there are no previous frames, can be set to 
appropriate values that will be known to those skilled in 
the art of speech processing. 

As those skilled in the art will appreciate, these 
conditional densities are obtained by inserting the 
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current values for the given (or known) variables into 
the terms of the density function of equation (19). For 
the conditional density p(a,k|...) this results ins 



p(a,k\...) « exp 
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which can be simplified to give: 
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(21) 



which is in the form of a standard Gaussian distribution 
having the following covariance matrix! 
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S T S I 
+ — 
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(22) 



The mean value of this Gaussian distribution can be 
determined by differentiating the exponent of equation 
(21) with respect to a and determining the value of a 
which makes the differential of the exponent equal to 
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zero. This yields a mean value of: 
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(23) 



5 A sample can then be drawn from this standard Gaussian 

distribution to give a* (where g is the g th iteration of 
the Gibbs sampler) with the model order (k*) being 
determined by a model order selection routine which will 
be described later. The drawing of a sample from this 

10 Gaussian distribution may be done by using a random 

number generator which generates a vector of random 
values which are uniformly distributed and then using a 
transformation of random variables using the covariance 
matrix and the mean value given in equations (22) and 

15 (23) to generate the sample. In this embodiment, 

however, a random number generator is used which 
generates random numbers from a Gaussian distribution 
having zero mean and a variance of one. This simplifies 
the transformation process to one of a simple scaling 

20 using the covariance matrix given in equation (22) and 

shifting using the mean value given in equation (23). 
Since the techniques for drawing samples from Gaussian 
distributions are well known in the art of statistical 
analysis, a further description of them will not be given 

25 here. A more detailed description and explanation can be 
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found in the book entitled "Numerical Recipes in C" , by 
Wo Press et al, Cambridge University Press, 1992 and in 
particular at chapter 7 «. 

5 As those skilled in. the art will appreciate, however, 

before a sample can be drawn from this Gaussian 
distribution, estimates of the raw speech samples must be 
available so that the matrix S and the vector s(n) are 
known* The way in which these estimates of the raw 
10 speech samples are obtained in this embodiment will be 

described later. 



A similar analysis for the conditional density p(h,r | „ „ • ) 
reveals that it also is a standard Gaussian distribution 
15 but having a covariance matrix and mean value given bys 

+ —7 (24) 

2 2 

from which a sample for h g can be drawn in the manner 
2 0 described above, with the channel model order (r*) being 

determined using the model order selection routine which 
will be described later. 
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A similar analysis for the conditional density p(o a 2 | ...) 
shows that: 
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where: 
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which can be simplified to give: 
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(26) 



which is also an Inverse Gamma distribution having the 
following parameters: 
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N 2B, 

a = — + a and B = ^ — 

e 2 e He 2 + p .£ 



(27) 
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A sample is then drawn from this Inverse Gamma 
distribution by firstly generating a random number from 
a uniform distribution and then performing a 
transformation of random variables using the alpha and 
beta parameters given in equation (27), to give (o e 2 )i. 
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A similar analysis for the conditional density p(a E 2 |...) 
reveals that it also is an Inverse Gamma distribution 
having the following parameters: 
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N 2R 

a e = — + a e ond p e = ! (28) 

2 2 + p e ^* 



where t 

A sample is then drawn from this Inverse Gamma 
distribution in the manner described above to give (a E 2 )^» 

A similar analysis for conditional density p(a a 2 | ...) 
reveals that it too is an Inverse Gamma distribution 
having the following parameters s 



2 + P^a-iL/Ca-jip 



15 a a = — + « a ^ P a = „ , Q 7 (29) 



A sample is then drawn from this Inverse Gamma 
distribution in the manner described above to give (a a 2 )9. 

20 Similarly, the conditional density p(o h 2 |...) is also an 

Inverse Gamma distribution but having the following 
parameters : 
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A sample is then drawn from this Inverse Gamma 
distribution in the manner described above to give (a h 2 )9. 



As those skilled in the art will appreciate , the Gibbs 
5 sampler requires an initial transient period to converge 

to equilibrium (known as burn-in) . Eventually, after L 
iterations, the sample (a L , k L , h L , r L , (o e 2 ) L , (cr £ 2 ) L , 
(^ a 2 ) L / (<7 h 2 ) L , s(n) L ) is considered to be a sample from the 
joint probability density function defined in equation 

10 (19). In this embodiment, the Gibbs sampler performs 

approximately one hundred and fifty (15 0) iterations on 
each frame of input speech and discards the samples from 
the first fifty iterations and uses the rest to give a 
picture (a set of histograms) of what the joint 

15 probability density function defined in equation (19) 

looks like. From these histograms, the set of AR 
coefficients (a) which best represents the observed 
speech samples (y(n)) from the analogue to digital 
converter 17 are determined. The histograms are also 

20 used to determine appropriate values for the variances 

and channel model coefficients (h) which can be used as 
the initial values for the Gibbs sampler when it 
processes the next frame of speech. 
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Model Order Selection 

As mentioned above, during the Gibbs iterations , the 
model order (k) of the AR filter and the model order (r) 
of the channel filter are updated using a model order 
selection routine. In this embodiment , this is performed 
using a technique called "Reversible jump Markov chain 
Monte Carlo computation" o This technique is described in 
the paper entitled "Reversible jump Markov chain Monte 
Carlo Computation and Bayesian model determination" by 
Peter Green. Biometrika. vol 82. pp 711 to 73 2. 19 95. 

Figure 4 is a flow chart which illustrates the processing 
steps performed during this model order selection routine 
for the AR filter model order (k) . As shown, in step si, 
a new model order (k 2 ) is proposed. In this embodiment, 
the new model order will normally be proposed as k 2 = k x 
± 1, but occasionally it will be proposed as k 2 = k x ± 2 
and very occasionally as k 2 = k x ± 3 etc. To achieve 
this, a sample is drawn from a discretised Laplacian 
density function centred on the current model order (k r ) 
and with the variance of this Laplacian density function 
being chosen a priori in accordance with the degree of 
sampling of the model order space that is required. 

The processing then proceeds to step s3 where a model 
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order variable (MO) is set equal to: 
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MO = max 
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(31) 
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where the ratio term is the ratio of the conditional 
probability given in equation (21) evaluated for the 
current AR filter coefficients (a) drawn by the Gibbs 
sampler for the current model order (k x ) and for the 
proposed new model order (k 2 ). If k 2 > k L , then the 
matrix S must first be resized and then a new sample must 
be drawn from the Gaussian distribution having the mean 
vector and covariance matrix defined by equations (22) 
and (23) (determined for the resized matrix S), to 
provide the AR filter coefficients (a <1:k2> ) for the new 
model order (k 2 ). If k 2 < k x then all that is required is 
to delete the last (k x - k 2 ) samples from the a vector. 
If the ratio in equation (31) is greater than one, then 
this implies that the proposed model order (k 2 ) is better 
than the current model order whereas if it is less than 
one then this implies that the current model order is 
better than the proposed model order. However, since 
occasionally this will not be the case, rather than 
deciding whether or not to accept the proposed model 
order by comparing the model order variable (MO) with a 
fixed threshold of one, in this embodiment, the model 
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order variable (MO) is compared, in step s5, with a 
random number which lies between zero and one. If the 
model order variable (MO) is greater than this random 
number , then the processing proceeds to step s7 where the 
5 model order is set to the proposed model order (k 2 ) and 

a count associated with the value of k 2 is incremented. 
If, on the other hand, the model order variable (MO) is 
smaller than the random number, then the processing 
proceeds to step s9 where the current model order is 
10 maintained and a count associated with the value of the 

current model order (k x ) is incremented. The processing 
then ends. 



This model order selection routine is carried out for 
15 both the model order of the AR filter model and for the 

model order of the channel filter model. This routine 
may be carried out at each Gibbs iteration. However, 
this is not essential. Therefore, in this embodiment, 
this model order updating routine is only carried out 
2 0 every third Gibbs iteration. 



Simula tion Smoother 

As mentioned above, in order to be able to draw samples 
using the Gibbs sampler, estimates of the raw speech 
samples are required to generate s(n), S and Y which are 



used in the Gibbs calculations. These could be obtained 
from the conditional probability density function 
p(s(n)|...). However, this is not done in this 
embodiment because of the high dimensionality of S(n) . 
Therefore, in this embodiment, a different technique is 
used to provide the necessary estimates of the raw speech 
samples. In particular, in this embodiment, a 

"Simulation Smoother" is used to provide these estimates. 
This Simulation Smoother was proposed by Piet de Jong in 
the paper entitled "The Simulation Smoother for Time 
Series Models", Biometrika (1995), vol 82,2, pages 33 9 to 
350. As those skilled in the art will appreciate, the 
Simulation Smoother is run before the Gibbs Sampler. It 
is also run again during the Gibbs iterations in order to 
update the estimates of the raw speech samples. In this 
embodiment, the Simulation Smoother is run every fourth 
Gibbs iteration . 

In order to run the Simulation Smoother, the model 
equations defined above in equations (4) and (6) must be 
written in "state space" format as follows: 

£(n) = A . l(n - 1 ) + £(n) 

(32) 

y(n) = tL T .l(n-\) + e(n) 
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where 



A = 



a \ a 2 a 3 

1 0 0 
0 1 0 



a k 0 

0 0 
0 0 



1 0 
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and 



s(n\ 



s(n) 
Hn-2) 



s(n-r+l) 



rxl 



e(n) 
0 
0 



rxl 
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With this state space representation, the dimensionality 
of the raw speech vectors (§(n) ) and the process noise 
vectors (e(n)) do not need to be Nxl but only have to be 
as large as the greater of the model orders - k and r. 
Typically , the channel model order (r) will be larger 
than the AR filter model order (k) • Hence, the vector of 
raw speech samples (s.(n)) and the vector of process noise 
(e(n)) only need to be rxl and hence the dimensionality 
of the matrix A only needs to be rxr. 
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The Simulation Smoother involves two stages - a first 
stage in which a Kalman filter is run on the speech 
samples in the current frame and then a second stage in 
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which a "smoothing" filter is run on the speech samples 
in the current frame using data obtained from the Kalman 
filter stage. Figure 5 is a flow chart illustrating the 
processing steps performed by the Simulation Smoother. 

5 As shown, in step s21, the system initialises a time 

variable t to equal one. During the Kalman filter stage, 
this time variable is run from t = 1 to N in order to 
process the N speech samples in the current frame being 
processed in time sequential order. After step s21, the 

0 processing then proceeds to step s23, where the following 

Kalman filter equations are computed for the current 
speech sample (y(t) ) being processed: 



w(t) = y{t) - h T l(t) 
d{t) = h T P(t)h + o 2 c 

(33) 

£(r+l) = A Sit) + k f (t)M0 
L(t) = A - k f (t).h T 

= AP(t)L(tf + o 2 e .I 

where the initial vector of raw speech samples (§.(1)) 
includes raw speech samples obtained from the processing 
of the previous frame (or if there are no previous frames 
then s(i) is set equal to zero for i < 1); P(l) is the 
5 variance of §.(1) (which can be obtained from the previous 
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frame or initially can be set to a e 2 ); h is the current 
set of channel model coefficients which can be obtained 
from the processing of the previous frame (or if there 
are no previous frames then the elements of h can be set 
to their expected values - zero); y(t) is the current 
speech sample of the current frame being processed and I 
is the identity matrix. The processing then proceeds to 
step s25 where the scalar values w(t) and d(t) are stored 
together with the rxr matrix L(t) (or alternatively the 
Kalman filter aain Ck*(t.) could be stored from which T./-h\ 
can be generated). The processing then proceeds to step 
s27 where the system determines whether or not all the 
speech samples in the current frame have been processed. 
If they have not, then the processing proceeds to step 
s29 where the time variable t is incremented by one so 
that the next sample in the current frame will be 
processed in the same way. Once all N samples in the 
current frame have been processed in this way and the 
corresponding values stored, the first stage of the 
Simulation Smoother is complete. 

The processing then proceeds to step s31 where the second 
stage of the Simulation Smoother is started in which the 
smoothing filter processes the speech samples in the 
current frame in reverse sequential order. As shown, in 
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step s31 the system runs the following set of smoothing 
filter equations on the current speech sample being 
processed together with the stored Kalman filter 
variables computed for the current speech sample being 
processed: 

C(f) = a 2 e (I - o]U(t)) 

~7V(0,C(0) 
V(f) = o 2 e U(t)L(t) 
r(r-l) = hd(ty l w(i) + L(tft(t) - V(t) T C(ty l n (t) 

(34) 

u(t-i) = hd{ty x t T + L(t) T u{t)L{t) + v(t) T c(ty l v(t) 

£(0 = a 2 e n(t) + n(i) w/zere £(0 = e(/-l) e(r-2) ... <?(/-r+l)] r 
f(0 = ^f(/-l) + £(f) where £(t) = [f(r) s(t-l) s\t~2) ... i(f-r+l)] r 

and l(t) = [e(0 0 0 ... 0 ] r 

where n(t) is a sample drawn from a Gaussian distribution 
having zero mean and covariance matrix C(t); the initial 
vector r(t=N) and the initial matrix U(t=N) are both set 
to zero; and s(0) is obtained from the processing of the 
previous frame (or if there are no previous frames can be 
set equal to zero). The processing then proceeds to step 
s33 where the estimate of the process noise (e(t)) for 
the current speech sample being processed and the 
estimate of the raw speech sample (s(t)) for the current 
speech sample being processed are stored. The processing 
then proceeds to step s35 where the system determines 



whether or not all the speech samples in the current 
frame have been processed- If they have not, then the 
processing proceeds to step s37 where the time variable 
t is decremented by one so that the previous sample in 
the current frame will be processed in the same way. 
Once all N samples in the current frame have been 
processed in this way and the corresponding process noise 
and raw speech samples have been stored, the second stage 
of the Simulation Smoother is complete and an estimate of 
s(n) will have been qenerated. 

As shown in equations (4) and (8), the matrix S and the 
matrix Y require raw speech samples s(n-N-l) to s(n-N- 
k+1) and s(n-N-l) to s(n-N-r+l) respectively in addition 
to those in s(n) „ These additional raw speech samples 
can be obtained either from the processing of the 
previous frame of speech or if there are no previous 
frames, they can be set to zero. With these estimates of 
raw speech samples, the Gibbs sampler can be run to draw 
samples from the above described probability density 
functions . 

Statistical Analysis Unit - Operation 

A description has been given above of the theory 
underlying the statistical analysis unit 21. A 



description will now be given with reference to Figures 
6 to 8 of the operation of the statistical analysis unit 
21. 



Figure 6 is a block . diagram illustrating the principal 
components of the statistical analysis unit 21 of this 
embodiment. As shown , it comprises the above described 
Gibbs sampler 41, Simulation Smoother 43 (including the 
Kalman filter 43-1 and smoothing filter 43-2) and model 
order selector 45. It also comprises a memory 47 which 
receives the speech samples of the current frame to be 
processed, a data analysis unit 49 which processes the 
data generated by the Gibbs sampler 41 and the model 
order selector 45 and a controller 50 which controls the 
operation of the statistical analysis unit 21. 

As shown in Figure 6, the memory 47 includes a non 
volatile menjpry area 47-1 and a working memory area 47-2. 
The non volatile memory 47-1 is used to store the joint 
probability density function given in equation (19) above 
and the equations for the variances and mean values and 
the equations for the Inverse Gamma parameters given 
above in equations (22) to (24) and (27) to (30) for the 
above mentioned conditional probability density functions 
for use by the Gibbs sampler 41. The non volatile memory 
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47-1 also stores the Kalman filter equations given above 
in equation (33) and the smoothing filter equations given 
above in equation 34 for use by the Simulation Smoother 
43. 

5 

Figure 7 is a schematic diagram illustrating the 
parameter values that are stored in the working memory 
area (RAM) 47-2. As shown, the RAM includes a store 51 
for storing the speech samples y f (1) to y £ (N) output by 

10 the analoque to diqital converter 17 for the current 

frame (f) being processed. As mentioned above, these 
speech samples are used in both the Gibbs sampler 41 and 
the Simulation Smoother 43. The RAM 47-2 also includes 
a store 53 for storing the initial estimates of the model 

15 parameters (g=0) and the M samples (g = 1 to M) of each 

parameter drawn from the above described conditional 
probability density functions by the Gibbs sampler 41 for 
the current frame being processed. As mentioned above, 
in this embodiment, M is 100 since the Gibbs sampler 41 

20 performs 150 iterations on each frame of input speech 

with the first fifty samples being discarded. The RAM 
47-2 also includes a store 55 for storing W(t), d(t) and 
L(t) for t = 1 to N which are calculated during the 
processing of the speech samples in the current frame of 

25 speech by the above described Kalman filter 43-1. The 



RAM 47-2 also includes a store 57 for storing the 
estimates of the raw speech samples (s f (t)) and the 
estimates of the process noise (e f (t)) generated by the 
smoothing filter 43-2, as discussed above. The RAM 47-2 
also includes a store 59 for storing the model order 
counts which are generated by the model order selector 45 
when the model orders for the AR filter model and the 
channel model are updated. 



Figure 8 is a flow diagram illustrating the control 
program used by the controller 50, in this embodiment, to 
control the processing operations of the statistical 
analysis unit 21. As shown, in step s41, the controller 
5 0 retrieves the next frame of speech samples to be 
processed from the buffer 19 and stores them in the 
memory store 51. The processing then proceeds to step 
s43 where initial estimates for the channel model, raw 
speech samples and the process noise and measurement 
noise statistics are set and stored in the store 53. 
These initial estimates are either set to be the values 
obtained during the processing of the previous frame of 
speech or, where there are no previous frames of speech, 
are set to their expected values (which may be zero) . 
The processing then proceeds to step s45 where the 
Simulation Smoother 4 3 is activated so as to provide an 



estimate of the raw speech samples in the manner 
described above* The processing then proceeds to step s47 
where one iteration of the Gibbs sampler 41 is run in 
order to update the channel model , speech model and the 
process and measurement noise statistics using the raw 
speech samples obtained in step s45. These updated 
parameter values are then stored in the memory store 53, 

The processing then proceeds to step s49 where the 
controller 50 determines whether or not to update the 
model orders of the AR filter model and the channel 
model. As mentioned above, in this embodiment r these 
model orders are updated every third Gibbs iteration. If 
the model orders are to be updated , then the processing 
proceeds to step s51 where the model order selector 45 is 
used to update the model orders of the AR filter model 
and the channel model in the manner described above. If 
at step s49 the controller 50 determines that the model 
orders are not to be updated, then the processing skips 
step s51 and the processing proceeds to step s5 3. At 
step s53, the controller 50 determines whether or not to 
perform another Gibbs iteration. If another iteration is 
to be performed, then the processing proceeds to decision 
block s55 where the controller 50 decides whether or not 
to update the estimates of the raw speech samples (s(t)). 



If the raw speech samples are not to be updated, then the 
processing returns to step s47 where the next Gibbs 
iteration is run. 

As mentioned above, in this embodiment, the Simulation 
Smoother 43 is run every fourth Gibbs iteration in order 
to update the raw speech samples. Therefore, if the 
controller 50 determines, in step s55 that there has been 
four Gibbs iterations since the last time the speech 
samples were updated, then the processing returns to step 
s45 where the Simulation Smoother is run again to provide 
new estimates of the raw speech samples (s(t)). Once the 
controller 50 has determined that the required 150 Gibbs 
iterations have been performed, the controller 50 causes 
the processing to proceed to step s57 where the data 
analysis unit 49 analyses the model order counts 
generated by the model order selector 45 to determine the 
model orders for the AR filter model and the channel 
model which best represents the current frame of speech 
being processed. The processing then proceeds to step 
s59 where the data analysis unit 49 analyses the samples 
drawn from the conditional densities by the Gibbs sampler 
41 to determine the AR filter coefficients (a), the 
channel model coefficients (h) , the variances of these 
coefficients and the process and measurement noise 



variances which best represent the current frame of 
speech being processed. The processing then proceeds to 
step s61 where the controller 50 determines whether or 
not there is any further speech to be processed . If 
there is more speech to be processed, then processing 
returns to step S41 and the above process is repeated for 
the next frame of speech. Once all the speech has been 
processed in this way, the processing ends 0 



Data Analysis unit 

A more detailed description of the data analysis unit 49 
will now be given with reference to Figure 9. As 
mentioned above, the data analysis unit 49 initially 
determines, in step s57, the model orders for both the AR 
filter model and the channel model which best represents 
the current frame of speech being processed. It does 
this using the counts that have been generated by the 
model order selector 45 when it was run in step s51. 
These counts are stored in the store 59 of the RAM 47-2. 
In this embodiment, in determining the best model orders, 
the data analysis unit 49 identifies the model order 
having the highest count. Figure 9a is an exemplary 
histogram which illustrates the distribution of counts 
that is generated for the model order (k) of the AR 
filter model. Therefore, in this example, the data 



analysis unit 4 9 would set the best model order of the AR 
filter model as five. The data analysis unit 49 performs 
a similar analysis of the counts generated for the model 
order (r) of the channel model to determine the best 
model order for the channel model. 

Once the data analysis unit 49 has determined the best 
model orders (k and r) , it then analyses the samples 
generated by the Gibbs sampler 41 which are stored in the 
store 53 of the RAM 47-2 , in order to determine parameter 
values that are most representative of those samples. 
It does this by determining a histogram for each of the 
parameters from which it determines the most 
representative parameter value. To generate the 

histogram, the data analysis unit 49 determines the 
maximum and minimum sample value which was drawn by the 
Gibbs sampler and then divides the range of parameter 
values between this minimum and maximum value into a 
predetermined number of sub-ranges or bins. The data 
analysis unit 49 then assigns each of the sample values 
into the appropriate bins and counts how many samples 
are allocated to each bin. It then uses these counts to 
calculate a weighted average of the samples (with the 
weighting used for each sample depending on the count for 
the corresponding bin), to determine the most 
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representative parameter value (known as the minimum mean 
square estimate (MMSE ) ) „ Figure 9b illustrates an 

example histogram which is generated for the variance 
(a e 2 ) of the process noise, from which the data analysis 
unit 49 determines that the variance representative of 
the sample is 0 o 3149, 

In determining the AR filter coefficients (a ± for i = i 
to k), the data analysis unit 49 determines and analyses 
a histogram of the samples for eanh nneffirip.nt. 
independently. Figure 9c shows an exemplary histogram 
obtained for the third AR filter coefficient (a 3 ), from 
which the data analysis unit 49 determines that the 
coefficient representative of the samples is -0.4977. 

In this embodiment, the data analysis unit 49 only 
outputs the AR filter coefficients which are passed to 
the coefficient convertor 23 shown in Figure 2. The 
remaining parameter values determined by the data 
analysis unit 49 are stored in the RAM 47-2 for use 
during the processing of the next frame of speech. As 
mentioned above, the AR filter coefficients output by the 
statistical analysis unit 21 are input to the coefficient 
convertor 2 3 which converts these coefficients into 
cepstral coefficients which are then compared with stored 



speech models 27 by the speech recognition unit 25 in 
order to generate a recognition result. 

As the skilled reader will appreciate , a speech 
processing technique has been described above which uses 
statistical analysis techniques to determine sets of AR 
filter coefficients representative of an input speech 
signal. The technique is more robust and accurate than 
prior art techniques which employ maximum likelihood 
estimators to determine the AR filter coefficients. This 
is because the statistical analysis of each frame uses 
knowledge obtained from the processing of the previous 
frame. In addition, with the analysis performed above, 
the model order for the AR filter model is not assumed to 
be constant and can vary from frame to frame. In this 
way, the optimum number of AR filter coefficients can be 
used to represent the speech within each frame. As a 
result, the AR filter coefficients output by the 
statistical analysis unit 21 will more accurately 
represent the corresponding input speech. Further still, 
since the underlying process model that is used separates 
the speech source from the channel, the AR filter 
coefficients that are determined will be more 
representative of the actual speech and will be less 
likely to include distortive effects of the channel. 
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Further still, since variance information is available 
for each of the parameters, this provides an indication 
of the confidence of each of the parameter estimates. 
This is in contrast to maximum likelihood and least 
5 square approaches, such as linear prediction analysis, 

where point estimates of the parameter values are 
determined • 



MULTI SPEAKER MULT I MICROPHONE 

1° A description will now be given of a multi speaker and 

multi microphone system which uses a similar statistical 
analysis to separate and model the speech from each 
speaker. Again, to facilitate understanding, a 

description will initially be given of a two speaker and 

15 two microphone system before generalising to a multi 

speaker and multi microphone system. 

Figure 10 is a schematic block diagram illustrating a 
speech recognition system which employs a statistical 

2 0 analysis unit embodying the present invention. As shown, 

the system has two microphones 7-1 and 7-2 which convert, 
in this embodiment, the speech from two speakers (not 
shown) into equivalent electrical signals which are 
passed to a respective filter circuit 15-1 and 15-2. In 

2 5 this embodiment, the filters 15 remove frequencies above 



8 kHz since the filtered signals are then converted into 
corresponding digital signals at a sampling rate of 16 
kHz by a respective analogue to digital converter 17-1 
and 17-2. The digitized speech samples from the analogue 
to digital converters 17 are then fed into the buffer 19, 
The statistical analysis unit 21 analyses the speech 
within successive frames of the input speech signal from 
the two microphones. In this embodiment, since there are 
two microphones there are two sequences of frames which 
are to be processed. In this embodiment, the two frame 
sequences are processed together so that the frame of 
speech from microphone 7-1 at time t is processed with 
the frame of speech received from the microphone 7-2 at 
time t. Again, in this embodiment, the frames of speech 
are non-overlapping and have a duration of 2 0 ms which, 
with the 16 kHz sampling rate of the analogue to digital 
converters 17, results in the statistical analysis unit 
21 processing blocks of 640 speech samples (corresponding 
to two frames of 320 samples). 

In order to perform the statistical analysis on the input 
speech, the analysis unit 21 assumes that there is an 
underlying process similar to that of the single speaker 
single microphone system described above. The particular 
model used in this embodiment is illustrated in Figure 



11 o As shown, the process is modelled by two speech 
sources 31-1 and 31-2 which generate, at time t = n, raw 
speech samples s x (n) and s 2 (n) respectively » Again, in 
this embodiment, each of the speech sources 31 is 
modelled by an auto aggressive (AR) process. In other 
words, there will be a respective equation (1) for each 
of the sources 31-1 and 31-2, thereby defining two 
unknown AR filter coefficient vectors a 1 and a 2 , each 
having a respective model order k 1 and k 2 „ These source 
models will also have a respective process noise 
component e x (n) and e 2 (n) * 

As shown in Figure 11, the model also assumes that the 
speech generated by each of the sources 31 is received by 
both microphones 7„ There is therefore a respective 
channel 33-11 to 33-22 between each source 31 and each 
microphone 7. There is also a respective measurement 
noise component ^(n) and e 2 (n) added to the signal 
received by each microphone. Again, in this embodiment, 
the statistical analysis unit 21 models each of the 
channels by a moving average (MA) filter. Therefore, the 
signal received from microphone 7-1 at time t = n is 
given by: 

y l W = h no sl (n) + h ln s x (n-l)+h n2 s l (n-2) + ...+h Uri S l (n-r n ) 

(35) 

+ h 2W s 2 (n) +h 2n s 2 (n-l) + h 2l2 s 2 {n-2) + ... + h 2Xr j 2 (n-r 2l ) + e ! (n) 



where , for example, h 112 is the channel filter coefficient 
of the channel between the first source 31-1 and the 
microphone 7-1 at time t = 2; and r 21 is the model order 
of the channel between the second speech source 31-2 and 
the microphone 7-1.. A similar equation will exist to 
represent the signal received from the other microphone 



In this embodiment, the statistical analysis unit 21 aims 
to determine values for the AR filter coefficients for 
the two speech sources, which best represent the observed 
signal samples from the two microphones in the current 
frame being processed. It does this, by determining the 
AR filter coefficients for the two speakers (a 1 and a 2 ) 
that maximise the joint probability density function of 
the speech models, channel models, raw speech samples and 
the noise statistics given the observed signal samples 
output from the two analogue to digital converters 17-1 
and 17-2, i.e. by determining: 



7-2. 



a 1 , a 2 ' 



max 




(36) 



. °e 2 . . % . («) . iy (w) y (») ) 



As those skilled in the art will appreciate, this is 
almost an identical problem to the single speaker single 
microphone system described above, although with more 



parameters o Again, to calculate this, the above 
probability is rearranged using Bayes law to give an 
equation similar to that given in equation (10) above. 
The only difference is that there will be many more joint 
probability density functions on the numerator. In 
Particular, the joint probability density functions which 
will need to be considered in this embodiment ares 

P(^(n) Is^n) ,s 2 (n) , h 1L , h 21 , ril , r 21 , a El 2 ) 
P(Y 2 (n) ! s x fn) ,s 2 (n) . h 12 , h 22 . r 12 . r 22 . a r2 2 ) 
P(s x (n) |a l ,k l f a 9l 2 ) P(s 2 (n) |a 2 ,k 2 ,a e2 2 ) 
PU 1 !* 1 ,^ 2 ,^) P(A 2 |k 2 ,a a2 2 ,iu a ) 
P ( Jin I r lx , a hll 2 , jj hll ) p ( h 12 1 r 12 , a hl2 2 , u hl2 ) 
P(ll2i |r 21 ,a h21 2 ,£i h21 ) P(h 22 |r 22 ,a h22 2 ,if h22 ) 

P(^al 2 |«al/3al) P ( O a2 2 | a a2 , P a2 ) P ( Q el 2 ) P ( O e2 2 ) 

P(cJ h n 2 |o£ hll ,3 hll ) P(a hl2 2 |a hl2 ,p hl2 ) P ( a h21 2 1 a h21 , (3 h21 ) 
P(CTh22 2 |a h22 ,3 h22 ) pfk 1 ) p(k 2 ) p(r xl ) p(r 12 ) p(r 21 ) p(r 22 ) 



Since the speech sources and the channels are independent 
of each other, most of these components will be the same 
as the probability density functions given above for the 
single speaker single microphone system. This is not 
the case, however, for the joint probability density 
functions for the vectors of speech samples (y^n) arid 
y 2 (n)) out from the analogue to digital converters 17, 



55 

since these signals include components from both the 
speech sources. The joint probability density function 
for the speech samples output from analogue to digital 
converter 17-1 will now be described in more detail. 



'10 



15 



P(J?(n) \s 1 (n),s 2 (n), 

Considering all the speech samples output from the 
analogue to digital converter 17-1 in a current frame 
being processed (and with h 110 and h 2 i 0 being set equal to 
one) , gives: 



where 
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s 2 (n-l) s 2 (n-2) 
s 2 (n-2) s 2 (n-3) 
s 2 (n-3) s 2 (n-4) 



*W 21 ) 
s 2 (n-r 2l -\) 
s 2 (n-r 2 .-2) 



s 2 (n-N) s 2 (n-N-l) . . s 2 (n-r 2l -N+l) 
and q'ln) = y x (n) - s^n) - s 2 (n) . 



Nxr,, 



As in the single speaker single microphone system 
described above, the joint probabilitv densitv functi on 
for the speech samples (xM 11 )) output from the analogue 
to digital converter 17-1 is determined from the joint 
probability density function for the associated 
measurement noise (a El 2 ) using equation (14) above. Again , 
the Jacobean will be one and the resulting joint 
probability density function will have the following 
forms 



(2 7i dp ) 2 exp 



lot 



11 
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(38) 
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As those skilled in the art will appreciate, this is a 
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15 
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Gaussian distribution as before. In this embodiment, the 
statistical analysis unit 21 assumes that the raw speech 
data which passes through the two channels to the 
microphone 7-1 are independent of each other. This 
allows the above Gaussian distribution to be simplified 
since the cross components Y 1 T Y 2 and Y 2 T Y 1 can be assumed 
to be zero. This gives: 

PiX 1 (w) | S 1 («) ^'Wi^^/n,^, < ) 



_N 

(Inolj 2 exp 



exp 



2cs 'l 



(39) 



2< 



.T V T. 



which is a product of two Gaussians, one for each of the 
two channels to the microphone 7-1. Note also that the 
initial term c^fn)* a 1 (n) has been ignored, since this is 
just a constant and will therefore only result in a 
corresponding scaling factor to the probability density 
function. This simplification is performed in this 
embodiment, since it is easier to draw a sample from each 
of the two Gaussians given in equation (39) individually 
rather than having to draw a single sample of both 
channels jointly from the larger Gaussian defined by 
equation ( 38 ) . 
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The Gibbs sampler is then used to draw samples from the 
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combined joint probability density function in the same 
way as for the single speaker-single microphone system, 
except that there are many more parameters and hence 
conditional densities to be sampled from. Again, the 
model order selector is used to adjust each of the model 
orders (k x ,K 2 and r xl - r 22 ) during the Gibbs iterations. 
As with the single source system described above, 
estimates of the raw speech samples from both the sources 
31-1 and 31-2 are needed for the Gibbs sampling ancT 
again, these are estimated using the Simulation Smoother. 
The state space equations for the two speaker and two 
microphone system are slightly different to those of the 
single speaker single microphone system and are therefore 
reproduced below. 



where 



r 1:2 » = ^ <i:2> .r 1:2> (/i-i) + £.r 1:2> («) 

* <1:2> («) = ZT <1:2> .r 1:2> (*-l) + D e .£ <l:2> (n) 
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r ,:2> 
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2 0 where m is the larger of the AR filter model orders and 

the MA filter model orders. Again, this results in 
slightly more complicated Kalman filter equations and 
smoothing filter equations and these are given below for 
completeness . 
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Kalman filter equations 



5 
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Smoothing Filter Equations 



C(0 =5_B T - BB T .U(t)BB T 
H(0 ~ N(0, C(0) 
F(0 = 5^ r U(t)L(t) 

U(t-\) = i/ <1:2 > D(ty l H <u2>T + L(t) T U(t)L(t) + F(O r C(r)- l F(0 (42) 
r I:2> (0 = -Bi? r z:(0 + itff) 

w/jere r ,:2> (0 = [e,(f) e,(/-l) .. e,(f-r+l) • e~ 2 (/) «? 2 (r-l) i 2 (t-r+l)] T 

r 1:2> w = ^ <l:2> r ,:2> (/-i) + r I:2> (o 

w/jere r 1:2> (/) = [r 1:2> (r) 0 ... 0 :r ,:2> (0 = [r 1:2> (r) 0 ... 0 f 
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The processing steps performed by the statistical 
analysis unit 21 for this two speaker two microphone 
system are the same as those used in the single speaker 
single microphone system described above with reference 
to Figures 8 and 9 and will not, therefore, be described 
again. 

In the above two speaker two microphone system, the 
system assumed that there were two speakers. In a 
general system, the number of speakers at any given time 
will be unknown. Figure 12 is a block diagram 
illustrating a multi-speaker multi-microphone speech 
recognition system. As shown in Figure 12, the system 
comprises a plurality of microphones 7-1 to 7-j, each of 
which receives speech signals from an unknown number of 
speech sources (not shown). The corresponding electrical 
signals output by the microphones 7 are then passed 
through a respective filter 15 and then digitized by a 
respective analogue to digital converter 17. The 
digitized speech signals from each of the microphones 7 
are then stored in the buffer 19 as before. As shown in 
Figure 12, the speech stored within the buffer 19 is fed 
into a plurality (m) of statistical analysis units 21. 
Each of the statistical analysis units is programmed to 
apply the current frame of speech samples to the 
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following probability density 
samples from it in the manner 



function and to then draw 
described above: 
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where N SEN is the number of microphones 7 and Z is -the 
number of speakers (which is different for each of the 
analysis units 21 and is set by a model comparison unit 
64). In this way, each of the analysis units 21 performs 
a similar analysis using the same input data (the speech 
samples from the microphones) but assumes that the input 
data was generated by a different number of speakers. 
For example, statistical analysis unit 21-1 may be 
programmed to assume that there are three speakers 
currently speaking whereas statistical analysis unit 21-2 
may be programmed to assume that there are five speakers 
currently speaking etc. 

During the processing of each frame of speech by the 
statistical analysis units 21 f some of the parameter 
samples drawn by the Gibbs sampler are supplied to the 
model comparison unit 64 so that it can identify the 
analysis unit that models best the speech in the current 
frame being processed. In this embodiment samples from 
every fifth Gibbs iteration are output to the model 
comparison unit 64 for this determination to be made. 
After each of the analysis units has finished sampling 
the above probability density function, it determines the 
mean AR filter coefficients for the programmed number of 
speakers in the manner described above and outputs these 



to a selector unit 62. At the same time, after the model 
comparison unit 64 has determined the best analysis unit, 
it passes a control signal to the selector unit 62 which 
causes the AR filter coefficients output by this analysis 
unit 21 to be passed to the speech recognition unit 25 
for comparison with the speech models 27- In this 
embodiment, the model comparison unit 64 is also arranged 
to reprogram each of the statistical analysis units 21 
after the processing of each frame has been completed, so 
that the number of speakers -fch^-h each of the analysis 
units is programmed to model is continuously adapted. In 
this way, the system can be used in, for example, a 
meeting where the number of participants speaking at any 
one time may vary considerably o 

Figure 13 is a flow diagram illustrating the processing 
steps performed in this embodiment, by each of the 
statistical analysis units 21. As can be seen from a 
comparison of Figure 13 with Figure 8, the processing 
steps employed are substantially the same as in the 
above embodiment, except for the additional steps S52, 
S54 and S56. A description of these steps will now be 
given. As shown in Figure 13, if step s54 determines 
that another Gibbs iteration is to be run, then the 
processing proceeds to step S52 where each of the 



statistical analysis units 21-1 determines whether or not 
to send the parameter samples from the last Gibbs 
iteration to the model comparison unit 64. As mentioned 
above, the model comparison unit 64 compares the samples 
generated by the analysis units every fifth Gibbs 
iteration. Therefore, if the samples are to be compared, 
then the processing proceeds to step S54 where each of 
the statistical analysis units 21-1 sends the current set 
of parameter samples to the model comparison unit 647 
The processing then proceeds to step S55 as before. Once 
the analysis units 21 have completed the sampling 
operation for the current frame, the processing then 
proceeds to step S56 where each of the statistical 
analysis units 21-1 informs the model comparison unit 64 
that it has completed the Gibbs iterations for the 
current frame before proceeding to step s57 as before. 

The processing steps performed by the model comparison 
unit 64 in this embodiment will now be described with 
reference to Figures 14 and 15. As shown, Figure 14 is 
a flow chart and illustrates the processing steps 
performed by the model comparison unit 64 when it 
receives the samples from each of the statistical 
analysis units 21 during the Gibbs iterations. As shown, 
in step S71, the model comparison unit 64 uses the 



samples received from each of the statistical analysis 
units 21 to evaluate the probability density function 
given in equation (43) . The processing then proceeds to 
step S73 where the model comparison unit 64 compares the 
evaluated probability density functions to determine 
which statistical analysis unit gives the highest 
evaluation „ The processing then proceeds to step S75 
where the model comparison unit 64 increments a count 
associated with the statistical analysis unit 21 having 
the highest evaluation. The processing then ends. 

Once all the statistical analysis units 21 have carried 
out all the Gibbs iterations for the current frame of 
speech being processed, the model comparison unit 
performs the processing steps shown in Figure 15. In 
particular , at step S81, the model comparison unit 64 
analyses the accumulated counts associated with each of 
the statistical analysis units, to determine the analysis 
unit having the highest count. The processing then 
proceeds to step S83 where the model comparison unit 64 
outputs a control signal to the selector unit 62 in order 
to cause the AR filter coefficients generated by the 
statistical analysis unit having the highest count to be 
passed through the selector 62 to the speech recognition 
unit 25. The processing then proceeds to step S85 where 



the model comparison unit 64 determines whether or not it 
needs to adjust the settings of each of the statistical 
analysis units 21, and in particular to adjust the number 
of speakers that each of the statistical analysis units 
assumes to be present within the speech. 

As those skilled in the art will appreciate, a multi 
speaker multi microphone speech recognition has been 
described above. This system has all the advantages 
described above for the single speaker single microphone 
system. It also has the further advantages that it can 
simultaneously separate and model the speech from a 
number of sources. Further, there is no limitation on 
the physical separation of the sources relative to each 
other or relative to the microphones. Additionally, the 
system does not need to know the physical separation 
between the microphones and it is possible to separate 
the signals from each source even where the number of 
microphones is fewer than the number of sources. 

Alternative Embodiments 

In the above embodiment, the statistical analysis unit 
was used as a pre-processor for a speech recognition 
system in order to generate AR coefficients 
representative of the input speech. It also generated a 
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number of other parameter values (such as the process 
noise variances and the channel model coef f icients ) , but 
these were not output by the statistical analysis unit. 
As those skilled in the art will appreciate , the AR 
coefficients and some of the other parameters which are 
calculated by the statistical analysis unit can be used 
for other purposes • For example, Figure 16 illustrates 
a speech recognition system which is similar to the 
speech recognition system shown in Figure 10 except that 
there is no coefficient converter since the speech 
recognition unit 25 and speech models 27 are AR 
coefficient based • The speech recognition system shown 
in Figure 16 also has an additional speech detection unit 
61 which receives the AR filter coefficients (a) together 
with the AR filter model order (k) generated by the 
statistical analysis unit 21 and which is operable to 
determine from them when speech is present within the 
signals received from the microphones 7. It can do this, 
since the AR filter model orders and the AR filter 
coefficient values will be larger during speech than when 
there is no speech present. Therefore, by comparing the 
AR filter model order (k) and/or the AR filter 
coefficient values with appropriate threshold values, the 
speech detection unit 61 can determine whether or not 
speech is present within the input signal. When the 
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speech detection unit 61 detects the presence of speech, 
it outputs an appropriate control signal to the speech 
recognition unit 25 which causes it to start processing 
the AR coefficients it receives from the statistical 
5 analysis unit 21. Similarly , when the speech detection 

unit 61 detects the end of speech , it outputs an 
appropriate control signal to the speech recognition unit 
25 which causes it to stop processing the AR coefficients 
it receives from the statistical analysis unit 21. 

•io 

In the above embodiments , a speech recognition system was 
described having a particular speech pre-processing front 
end which performed a statistical analysis of the input 
speech. As the those skilled in the art will appreciate, 

15 this pre-processing can be used in speech processing 

systems other than speech recognition systems. For 
example, as shown in Figure 17, the statistical analysis 
unit 21 may form a front end to a speaker verification 
system 65. In this embodiment, the speaker verification 

20 system 65 compares the sequences of AR filter 

coefficients for the different speakers output by the 
statistical analysis unit 21 with pre-stored speaker 
models 67 to determine whether or not the received speech 
corresponds to known users. 
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Figure 18 illustrates another application for the 
statistical analysis unit 21. In particular, Figure 18 
shows an acoustic classification system. The statistical 
analysis unit 21 is used to generate the AR filter 
coefficients for each of a number of acoustic sources 
(which may or may not be speech) in the manner described 
above • The coefficients are then passed to an acoustic 
classification system 66 which compares the AR 
coefficients of each source with pre-stored acoustic 
models 68 to generate a classification result. Such a 
system may be used, for example, to distinguish and 
identify, for example, percussion sounds, woodwind 
sounds, brass sounds as well as speech. 

Figure 19 illustrates another application for the 
statistical analysis unit 21. In particular, Figure 19 
shows a speech encoding and transmission system. The 
statistical analysis unit 21 is used to generate the AR 
filter coefficients for each speaker in the manner 
described above. These coefficients are then passed to a 
channel encoder which encodes the sequences of AR filter 
coefficients so that they are in a more suitable form for 
transmission through a communications channel. The 
encoded AR filter coefficients are then passed to a 
transmitter 7 3 where the encoded data is used to modulate 



a carrier signal which is then transmitted to a remote 
receiver 75. The receiver 75 demodulates the received 
signal to recover the encoded data which is then decoded 
by a decoder 76. The sequences of AR filter coefficients 
output by the decoder are then either passed to a speech 
recognition unit 77 which compares the sequences of AR 
filter coefficients with stored reference models (not 
shown) to generate a recognition result or to a speech 
synthesis unit 79 which re-generates the speech and 
outputs it via a loudspeaker 81. As shown, prior to 
application to the speech synthesis unit 79, the 
sequences of AR filter coefficients may also pass through 
an optional processing unit 83 (shown in phantom) which 
can be used to manipulate the characteristics of the 
speech that is synthesised. One of the significant 
advantages of using the statistical analysis unit 
described above is that the model orders for the AR 
filter models are not assumed to be constant and will 
vary from frame to frame. In this way, the optimum 
number of AR filter coefficients will be used to 
represent the speech from each speaker within each frame. 
In contrast, with linear prediction analysis, the number 
of AR filter coefficients is assumed to be constant and 
hence the prior art techniques tend to over parameterise 
the speech in order to ensure that information is not 



lost. As a result, with the statistical analysis 
described above, the amount of data which has to be 
transmitted from the transmitter to the receiver will be 
less than with the prior art systems which assume a fixed 
size of AR filter model. 

Figure 20 shows another system which uses the statistical 
analysis unit 21 described above. The system shown in 
Figure 20 automatically generates voice annotation data 
for adding to a data file. The system may be used, for 
example, to generate voice annotation data for a meeting 
involving a number of participants, with the data file 91 
being a recorded audio file of the meeting. In use, as 
the meeting progresses, the speech signals received from 
the microphones is processed by the statistical analysis 
unit 21 to separate the speech signals from each of the 
Participants. Each participant's speech is then tagged 
with an identifier identifying who is speaking and then 
passed to a speech recognition unit 97, which generates 
words and/or phoneme data for each speaker. This word 
and/or phoneme data is then passed to a data file 
annotation unit 99, which annotates the data file 91 with 
the word and/or phoneme data and then stores the 
annotated data file in a database 101. In this way, 
subsequent to the meeting, a user can search the data 
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file 91 for a particular topic that was discussed at the 
meeting by a particular participant. 

In addition , in this embodiment, the statistical analysis 
5 unit 21 also outputs the variance of the AR filter 

coefficients for each of the speakers. This variance 
information is passed to a speech quality assessor 93 
which determines from this variance data, a measure of 
the quality of each participant's speech. As those 

10 skilled in the art will appreciate, in general, when the 

input speech is of a high quality (i.e. not disturbed by 
high levels of background noise), this variance should be 
small and where there are high levels of noise, this 
variance should be large. The speech quality assessor 93 

15 then outputs this quality indicator to the data file 

annotation unit 99 which annotates the data file 91 with 
this speech quality information. 



As the those skilled in the art will appreciate, these 
2 0 speech quality indicators which are stored with the data 

file are useful for subsequent retrieval operations. In 
particular, when the user wishes to retrieve a data file 
91 from the database 101 (using a voice query), it is 
useful to know the quality of the speech that was used to 
25 annotate the data file and/or the quality of the voice 



retrieval query used to retrieve the data file, since 
this will affect the retrieval performance. In 
particular if the voice annotation is of a high quality 
and the user's retrieval query is also of a high quality, 
then a stringent search of the database 101 can be 
performed, in order to reduce the amount of false 
identifications. In contrast, if the original voice 
annotation is of a low quality or if the user's retrieval 
query is of a low quality, then a less stringent search 
of the database 101 can be performed to give a higher 
chance of retrieving the correct data file 91. 

In addition to using the variance of the AR filter 
coefficients as an indication of the speech quality, the 
variance (a e 2 ) of the process noise is also a good measure 
of the quality of the input speech, since this variance 
is also measure of the energy in the process noise. 
Therefore, the variance of the process noise can be used 
in addition to or instead of the variance of the AR 
filter coefficients to provide the measure of quality of 
the input speech. 

In the embodiment described above with reference to 
Figure 16, the statistical analysis unit 21 may be used 
solely for providing information to the speech detection 



unit 61 and a separate speech preprocessor may be used to 
parameterise the input speech for use by the speech 
recognition unit 25. However , such separate 
parameterisation of the input speech is not preferred 
because of the additional processing overhead involved. 

The above embodiments have described a statistical 
analysis technique for processing signals received from 
a number of microphones in response to speech signals 
generated by a plurality of speakers. As those skilled 
in the art will appreciate, the statistical analysis 
technique described above may be employed in fields other 
than speech and/or audio processing. For example , the 
system may be used in fields such as data communications, 
sonar systems, radar systems etc. 

In the first embodiment described above, the AR filter 
coefficients output by the statistical analysis unit 21 
were converted into cepstral coefficients since the 
speech recognition unit used in the first embodiment was 
a cepstral based system. As those skilled in the art will 
appreciate, if the speech recognition system is designed 
to work with other spectral coefficients, then the 
coefficient converter 2 3 may be arranged to convert the 
AR filter coefficients into the appropriate spectral 



parameters o Alternatively still, if the speech 

recognition system is designed to operate with AR 
coefficients , then the coefficient converter 23 is 
unnecessary., 

In the above embodiments, Gaussian and Inverse Gamma 
distributions were used to model the various prior 
probability density functions of equation (19). As those 
skilled in the art of statistical analysis will 
appreciate, the reason these distributions were chosen is 
that they are conjugate to one another. This means that 
each of the conditional probability density functions 
which are used in the Gibbs sampler will also either be 
Gaussian or Inverse Gamma. This therefore simplifies the 
task of drawing samples from the conditional probability 
densities. However, this is not essential. The noise 
probability density functions could be modelled by 
Laplacian or student-t distributions rather than Gaussian 
distributions. Similarly, the probability density 
functions for the variances may be modelled by a 
distribution other than the Inverse Gamma distribution. 
For example, they can be modelled by a Rayleigh 
distribution or some other distribution which is always 
positive. However, the use of probability density 
functions that are not conjugate will result in increased 



complexity in drawing samples from the conditional 
densities by the Gibbs sampler. 

Additionally , whilst the Gibbs sampler was used to draw 
samples from the probability density function given in 
equation (19), other sampling algorithms could be used. 
For example the Metropolis-Hastings algorithm (which is 
reviewed together with other techniques in a paper 
entitled "Probabilistic inference using Markov chain 
Monte Carlo methods" by R. Neal, Technical Report CRG- 
TR-93-1, Department of Computer Science, University of 
Toronto, 1993) may be used to sample this probability 
density. 

In the above embodiment, a Simulation Smoother was used 
to generate estimates for the raw speech samples. This 
Simulation Smoother included a Kalman filter stage and a 
smoothing filter stage in order to generate the estimates 
of the raw speech samples. In an alternative embodiment, 
the smoothing filter stage may be omitted, since the 
Kalman filter stage generates estimates of the raw speech 
(see equation (33)). However, these raw speech samples 
were ignored, since the speech samples generated by the 
smoothing filter are considered to be more accurate and 
robust. This is because the Kalman filter essentially 
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generates a point estimate of the speech samples from the 
joint probability density function for the raw speech, 
whereas the Simulation Smoother draws a sample from this 
probability density function o 

5 

In the above embodiment, a Simulation Smoother was used 
in order to generate estimates of the raw speech samples. 
It is possible to avoid having to estimate the raw speech 
samples by treating them as "nuisance parameters" and 

10 integratinq them out of equation (19) « However, this is 

not preferred, since the resulting integral will have a 
much more complex form than the Gaussian and Inverse 
Gamma mixture defined in equation (19) 0 This in turn will 
result in more complex conditional probabilities 

15 corresponding to equations (20) to (30). In a similar 

way, the other nuisance parameters (such as the 
coefficient variances or any of the Inverse Gamma, alpha 
and beta parameters) may be integrated out as well. 
However, again this is not preferred, since it increases 

2 0 the complexity of the density function to be sampled 

using the Gibbs sampler. The technique of integrating 
out nuisance parameters is well known in the field of 
statistical analysis and will not be described further 
here . 
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In the above embodiment, the data analysis unit analysed 
the samples drawn by the Gibbs sampler by determining a 
histogram for each of the model parameters and then 
determining the value of the model parameter using a 
weighted average of the samples drawn by the Gibbs 
sampler with the weighting being dependent upon the 
number of samples in the corresponding bin. In an 
alterative embodiment, the value of the model parameter 
may be determined from the histogram as being the value 
of the model parameter having the highest count. 
Alternatively, a predetermined curve (such as a bell 
curve) could be fitted to the histogram in order to 
identify the maximum which best fits the histogram. 

In the above embodiment, the statistical analysis unit 
modelled the underlying speech production process with 
separate speech source models (AR filters) and channel 
models. Whilst this is the preferred model structure, 
the underlying speech production process may be modelled 
without the channel models. In this case, there is no 
need to estimate the values of the raw speech samples 
using a Kalman filter or the like, although this can 
still be done. However, such a model of the underlying 
speech production process is not preferred, since the 
speech model will inevitably represent aspects of the 
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channel as well as the speech. Further, although the 
statistical analysis unit described above ran a model 
order selection routine in order to allow the model 
orders of the AR filter model and the channel model to 
vary, this is not essential . In particular, the model 
order of the AR filter model and the channel model may be 
fixed in advance, although this is not preferred since it 
will inevitably introduce errors into the representation. 

In the above embodiments, the speech that was processed 
was received from a user via a microphone. As those 
skilled in the art will appreciate, the speech may be 
received from a telephone line or may have been stored on 
a recording medium. In this case, the channel models 
will compensate for this so that the AR filter 
coefficients representative of the actual speech that has 
been spoken should not be significantly affected. 



In the above embodiments, the speech generation process 
was modelled as an auto-regressive (AR) process and the 
channel was modelled as a moving average (MA) process. 
As those skilled in the art will appreciate, other signal 
models may be used. However, these models are preferred 
because it has been found that they suitably represent 
25 the speech source and the channel they are intended to 
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20 



81 



model . 

In the above embodiments, during the running of the model 
order selection routine, a new model order was proposed 
5 by drawing a random variable from a predetermined 

Laplacian distribution function. As those skilled in 
the art will appreciate, other techniques may be used. 
For example the new model order may be proposed in a 
deterministic way ( ie under predetermined rules ) , 
10 provided that the model order space is sufficiently 

sampled. 
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CLAIMS 

lo A signal processing apparatus comprising; 

one or more receivers for receiving a set of signal 
values representative of signals generated by a plurality 
of signal sources; 

a memory for storing a predetermined function which 
gives, for a given set of received signal values , a 
probability density for parameters of a respective siqnal 
model, each of which is assumed to have generated a 
respective one of the signals represented by the received 
signal values ; 

means for applying the set of received signal values 
to said stored function to generate said probability 
density function; 

means for processing said probability density 
function to derive samples of parameter values from said 
probability density function; and 

means for analysing at least some of said derived 
samples of parameter values to determine parameter values 
that are representative of the signals generated by at 
least one of said sources. 



An apparatus according to claim 1, wherein said 
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processing means is operable to draw samples of parameter 
values from said probability density function and wherein 
said analysing means is operable to analyse said drawn 
samples to determine said parameter values that are 
5 representative of the signals generated by at least one 

of said sources. 



3. An apparatus according to claim 2 , wherein said 
processing means is operable to draw samples iteratively 

^^10 from said probability density function. 

4. An apparatus according to claim 2 or 3 , wherein said 
processing means comprises a Gibbs sampler, 

15 5. An apparatus according to any preceding claim, 

wherein said analysing means is operable to determine a 
histogram of said derived samples and wherein said 
parameter values are determined from said histogram. 

20 6 - An apparatus according to claim 5, wherein said 

analysing means is operable to determine said parameter 
values using weighted sum of said derived samples, and 
wherein the weighting for each sample is determined from 
said histogram. 
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7 «, An apparatus according to any preceding claim, 
wherein said receiving means is operable to receive a 
sequence of sets of signal values representative of 
signals generated by said plurality of signal sources and 
wherein said applying means, processing means and 
analysing means are operable to perform their function 
with respect to each set of received signal values in 
order to determine parameter values that are 
representative of the signals generated by at least one 
of said sources. 

80 An apparatus according to claim 7, wherein said 
processing means is operable to use the parameter values 
obtained during the processing of a preceding set of 
signal values as initial estimates for the parameter 
values of a current set of signal values being processed. 

9o An apparatus according to claim 7 or 8, wherein said 
sets of signal values in said sequence are non- 
overlapping . 

10. An apparatus according to any preceding claim, 
wherein said signal model comprises an auto-regressive 
process model, wherein said parameters include auto- 
regressive model co-efficients. 
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11 . An apparatus according to any preceding claim, 
wherein said analysing means is operable to analyse at 
least some of said derived samples of parameter values to 
determine a measure of the variance of said samples and 
wherein the apparatus further comprises means for 
outputting a signal indicative of the quality of said 
received set of signal values in dependence upon said 
determined variance measure. 



12. An apparatus according to claim 11, wherein said 
probability density function is in terms of said variance 
measure, wherein said processing means is operable to 
draw samples of said variance measure from said 
probability density function and wherein said analysing 
means is operable to analyse the drawn variance samples. 

13. An apparatus according to any preceding claim, 
wherein said received set of signal values are 
representative of signals generated by a plurality of 
signal sources as modified by a respective transmission 
channel between each source and the or each receiver; 
wherein said predetermined function includes a plurality 
of first parts each associated with a respective one of 
said signal sources and each having a set of parameters 
which models the corresponding source and a plurality of 
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second parts each for modelling a respective one of said 
transmission channels between said sources and said one 
or more receivers, each second part having a respective 
set of parameters which models the corresponding channel 
and wherein said processing means is operable to obtain 
values of the parameters associated with at least one of 
said first parts from said probability density function. 



10 14. An apparatus according to claim 13, wherein said 

function is in terms of a set of raw signal values 
representative of the signals generated by said sources 
before being modified by said transmission channels, 
wherein the apparatus further comprises second processing 

15 means for processing the received set of signal values 

with initial estimates of said first and second 
parameters, to generate an estimate of the raw signal 
values corresponding to the received set of signal values 
and wherein said applying means is operable to apply said 

20 estimated set of raw signal values to said function in 

addition to said set of received signal values. 

15. An apparatus according to claim 14, wherein said 
second processing means comprises a simulation smoother. 

25 
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16. An apparatus according to claim 14 or 15, wherein 
said second processing means comprises a Kalman filter. 



17. An apparatus according to any of claims 13 to 16, 
wherein one or more of said second parts comprises a 
moving average model and wherein the corresponding second 
parameters comprise moving average model coefficients. 



18. An apparatus according to any preceding claim7 
further comprising means for evaluating said probability 
density function for the set of received signal values 
using one or more derived samples of parameter values for 
different numbers of parameter values for each of said 
signal models, to determine respective probabilities that 
the predetermined signal models have those respective 
parameter values and wherein said processing means is 
operable to process at least some of said derived samples 
of parameter values and said evaluated probabilities to 
determine said parameter values that are representative 
of the signals generated by said at least one of said 
sources . 

19. An apparatus according to any preceding claim, 
wherein said analysing means is operable to determine 
respective parameter values that are representative of 
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each of the signals generated by said sources. 

20 o An apparatus according to any preceding claim, 
further comprising means for varying said stored 
predetermined function to vary the number of signal 
sources represented thereby, and wherein said applying 
means, processing means and analysing means are operable 
to perform their function for the respective different 
predetermined functions in order to determine the number" 
of signal sources. 

21. An apparatus according to any preceding claim, 
wherein said memory stores a plurality of predetermined 
functions each of which gives, for a given set of 
received signal values, a probability density for 
parameters of a respective different plurality of signal 
models which are assumed to have generated the signals 
represented by the received signal values; wherein said 
applying means, processing means and analysing means are 
operable to perform their function with respect to each 
of said stored functions and wherein the apparatus 
further comprises evaluation means for evaluating each of 
said functions with the determined parameter values for 
the respective functions and means for comparing the 
evaluated functions to determine the number of sources 
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that best represents the received signal values. 

22. An apparatus according to any preceding claim / 
comprising a plurality of receivers. 

23. An apparatus according to any preceding claim, 
wherein said received set of signal values are 
representative of audio signals. 

24. An apparatus according to claim 23, wherein said 
received set of signal values are representative of 
speech signals . 

25. An apparatus according to any preceding claim, 
further comprising means for comparing said determined 
parameter values with pre-stored parameter values to 
generate a comparison result. 

26. An apparatus according to any of claims 1 to 24, 
further comprising recognition means for comparing said 
determined parameter values with pre-stored reference 
models to generate a recognition result. 
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27. An apparatus according to any of claims 1 to 24, 
further comprising speaker verification means for 



comparing said determined parameter values with pre- 
stored speaker models to generate a verification result. 

28 o An apparatus according to any preceding claim, 
further comprising means for encoding said determined 
parameter values. 

29 o An apparatus according to claim 28, further 
comprising means for transmitting said encoded parameter- 
values and a receiver for receiving the transmitted 
encoded parameter values, which receiver includes 
decoding means for decoding the encoded parameter values 
and processing means for generating an output signal in 
dependence upon the decoded parameter values. 

30. An apparatus according to claim 29, wherein said 
processing means of said receiver comprises means for 
synthesising speech using the decoded parameter values. 

31. An apparatus according to claim 2 9 or 30, wherein 
said processing means of said receiver comprises 
recognition processing means for performing recognition 
processing of said decoded parameter values to generate 
a recognition result. 



32. An apparatus for generating annotation data for use 
in annotating a data file, the apparatus comprising: 

means for receiving an audio annotation 
representative of audio signals generated by a plurality 
of signal sources; 

an apparatus according to any of claims 1 to 24 for 
generating parameters values that are representative of 
the signals generated by at least one of said sources; 
and 

means for generating annotation data using said 
determined parameter values . 

33. An apparatus according to claim 32 , wherein said 
audio annotation comprises speech data and wherein said 
apparatus further comprises speech recognition means for 
processing the parameter values to identify words and/or 
phonemes within the speech data; and wherein said 
annotation data comprises said word and/or phoneme data. 

34. An apparatus according to claim 33, wherein said 
annotation data defines a phoneme and word lattice. 

35. An apparatus for searching a database comprising a 
plurality of annotations which include annotation data, 
the apparatus comprising: 
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means for receiving an audio input query 
representative of audio signals generated by a plurality 
of audio sources; 

an apparatus according to any of claims 1 to 24 for 
5 determining parameter values that are representative of 

the signals generated by at least one of said sources; 
and 

means for comparing data representative of said 
determined parameter values with the annotation data of 
10 one or more of said annotations,, 



36. An apparatus according to claim 35 , wherein said 
audio query comprises speech data and wherein the 
apparatus further comprises speech recognition means for 

15 processing the speech data to identify words and/or 

phoneme data for the speech data; wherein said annotation 
data comprises word and/or phoneme data and wherein said 
comparing means compares said word and/or phoneme data of 
said query with said word and/or phoneme data of said 

2 0 annotation* 



37. A signal processing apparatus comprising: 

one or more receiving means for receiving. a set of 
signal values representative of a plurality of signals 
generated by a respective plurality of signal sources as 



modified by a respective transmission channel between 
each source and the or each receiving means; 

means for storing data defining a predetermined 
function derived from a predetermined signal model which 
includes a plurality, of first parts each associated with 
a respective one of said signal sources and each having 
a set of parameters which models the corresponding source 
and a plurality of second parts each for modelling a 
respective one of said transmission channels between said 
sources and said one or more receiving means, each second 
part having a respective set of parameters which models 
the corresponding channel, said function being in terms 
of said parameters and generating, for a given set of 
received signal values, a probability density function 
which defines, for a given set of parameters, the 
probability that the predetermined signal model has those 
parameter values, given that the signal model is assumed 
to have generated the received set of signal values; 

means for applying said set of received signal 
values to said function; 

means for processing said function with those values 
applied to derive samples of the parameters associated 
with at least one of said first parts from said 
probability density function; and 

means for analysing at least some of said derived 
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samples to determine values of said parameters of said at 
least one first part, that are representative of the 
signal generated by the source corresponding to said at 
least one first part before it was modified by the 
5 corresponding transmission channel . 

38 o A signal processing method comprising the steps of s 
receiving a set of signal values representative of 
signals generated by a plurality of signal sources using 

10 one or more receivers; 

storing a predetermined function which gives, for 
a given set of received signal values, a probability 
density for parameters of a respective signal model, 
each of which is assumed to have generated a respective 

15 one of the signals represented by the received signal 

values ; 

applying the set of received signal values to said 
stored function to generate said probability density 
function; 

20 processing said probability density function to 

derive samples of parameter values from said probability 
density function; and 

analysing at least some of said derived samples of 
parameter values to determine parameter values that are 

25 representative of the signals generated by at least one 
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of said sources. 

39. A method according to claim 38, wherein said 
processing step draws samples of parameter values from 
5 said probability density function and wherein said 

analysing step analyses said drawn samples to determine 
said parameter values that are representative of the 
signals generated by at least one of said sources. 

10 40. A method according to claim 39, wherein said 

processing step draws samples iteratively from said 
probability density function. 

41. A method according to claim 39 or 40 wherein said 
15 processing step uses a Gibbs sampler. 

42. A method according to any of claims 3 8 to 41, 
wherein said analysing step determines a histogram of 
said derived samples and wherein said parameter values 

20 are determined from said histogram. 

43. A method according to claim 42, wherein said 
analysing step determines said parameter values using a 
weighted sum of said derived samples, and wherein the 

25 weighting for each sample is determined from said 
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histogram* 

44. A method according to any of claims 38 to 43, 
wherein said receiving step receives a sequence of sets 

5 of signal values representative of signals generated by 

said plurality of signal sources and wherein said 
applying step, processing step and analysing step are 
performed for each set of received signal values in order 
to determine parameter values that are representative of 
10 the signals generated by at least one of said sources. 

45. A method according to claim 44, wherein said 
processing step uses the parameter values obtained during 
the processing of a preceding set of signal values as 

15 initial estimates for the parameter values of a current 

set of signal values being processed. 

46. A method according to claim 44 or 45, wherein said 
sets of signal values in said sequence are non- 
20 overlapping. 

47. A method according to any of claims 3 8 to 46, 
wherein said signal model comprises an auto-regressive 
process model, wherein said parameters include auto- 

25 regressive model co-efficients. 



48- A method according to any of claims 38 to 47 , 
wherein said analysing step analyses at least some of 
said derived samples of parameter values to determine a 
measure of the variance of said samples and wherein the 
method further comprises the step of outputting a signal 
indicative of the quality of said received set of signal 
values in dependence upon said determined variance 
measure- 



49. A method according to claim 48, wherein said 
probability density function is in terms of said variance 
measure, wherein said processing step draws samples of 
said variance measure from said probability density 
function and wherein said analysing step analyses the 
drawn variance samples. 

50. A method according to any of claim 38 to 49, wherein 
said received set of signal values are representative of 
signals generated by a plurality of signal sources as 
modified by a respective transmission channel between 
each source and the or each receiver; wherein said 
predetermined function includes a plurality of first 
parts each associated with a respective one of said 
signal sources and each having a set of parameters which 
models the corresponding source and a plurality of second 
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parts each for modelling a respective one of said 
transmission channels between said sources and said one 
or more receivers, each second part having a respective 
set of parameters which models the corresponding channel 
and wherein said processing step obtains values of the 
parameters associated with at least one of said first 
parts from said probability density function. 



51 o A method according to claim 5 0 , wherein said 
function is in terms of a set of raw signal valnp? 
representative of the signals generated by said sources 
before being modified by said transmission channels, 
wherein the method further comprises a second processing 
step of processing the received set of signal values with 
initial estimates of said first and second parameters to 
generate an estimate of the raw signal values 
corresponding to the received set of signal values and 
wherein said applying step applies said estimated set of 
raw signal values to said function in addition to said 
set of received signal values* 

52. A method according to claim 51, wherein said second 
processing step uses a simulation smoother. 



53. A method according to claim 51 or 52, wherein said 



second processing step uses a Kalman filter. 

54. A method according to any of claims 50 to 5 3 , 
wherein one or more of said second parts comprises a 
moving average model and wherein the corresponding second 
parameters comprise moving average model coefficients. 

55. A method according to any of claims 38 to 5 4 , 
further comprising the step of evaluating said 
probability density function for the set of received 
signal values using one or more derived samples of 
parameter values for different numbers of parameter 
values for each of said signal models, to determine 
respective probabilities that the predetermined signal 
models have those respective parameter values and wherein 
said processing step processes at least some of said 
derived samples of parameter values and said evaluated 
probabilities to determine said parameter values that are 
representative of the signals generated by said at least 
one of said sources. 

56. A method according to any of claims 38 to 55 , 
wherein said analysing step determines respective 
parameter values that are representative of each of the 
signals generated by said sources. 
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57. A method according to any of claims 38 to 56, 
further comprising the step of varying said stored 
predetermined function to vary the number of signal 
sources represented thereby, and wherein said applying 
step, processing step and analysing step are performed 
for the respective different predetermined functions in 
order to determine the number of signal sources. 



58 . A method according to any of claims 38 to 57, 
wherein a plurality of predetermined functions are 
stored, each of which gives, for a given set of received 
signal values, a probability density for parameters of a 
respective different plurality of signal models which are 
assumed to have generated the signals represented by the 
received signal values; wherein said applying step, 
processing step and analysing step are performed with 
respect to each of said stored functions and wherein the 
method further comprises the step of evaluating each of 
said functions with the determined parameter values for 
the respective functions and comparing the evaluated 
functions to determine the number of sources that best 
represents the received signal values. 
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59. A method according to any of claims 38 to 58, 
wherein said receiving step uses a plurality of receivers 



to receive said signal values. 

60. A method according to any of claims 38 to 59, 
wherein said received set of signal values are 
representative of audio signals. 

61. A method according to claim 60 , wherein said 
received set of signal values are representative of 
speech signals. 

62. A method according to any of claims 38 to 61, 
further comprising the step of comparing said determined 
parameter values with pre-stored parameter values to 
generate a comparison result. 

63. A method according to any of claims 38 to 61, 
further comprising the step of using a recognition 
processor for comparing said determined parameter values 
with pre-stored reference models to generate a 
recognition result. 

64. A method according to any of claims 38 to 61 , 
further comprising the step of using a speaker 
verification system for comparing said determined 
parameter values with pre-stored speaker models to 



generate a verification result. 

65. A method according to any of claims 38 to 64 , 
further comprising the step of encoding said determined 
parameter values. 

66. A method according to claim 65, further comprising 
the step of transmitting said encoded parameter values 
and, at a receiver, receiving the transmitted encoded 
parameter values, decoding the encoded parameter valims 
and generating an output signal in dependence upon the 
decoded parameter values. 

67. A method according to claim 66, wherein said 
generating step at said receiver synthesises speech using 
the decoded parameter values. 

68. A method according to claim 66 or 67, wherein said 
generating step at said receiver comprises performing 
recognition processing of said decoded parameter values 
to generate a recognition result. 

69. A method for generating annotation data for use in 
annotating a data file, the method comprising the steps 
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receiving an audio annotation representative of 
audio signals generated by a plurality of signal 
sources ; 

a method according to any of claims 38 to 61 for 
5 generating parameters values that are representative of 

the signals generated by at least one of said sources; 
and 

generating annotation data using said determined 
parameter values . 

0 

70. A method according to claim 69 , wherein said audio 
annotation comprises speech data and wherein said method 
further comprises the step of using a speech recognition 
system to process the parameter values to identify words 

5 and/or phonemes within the speech data; and wherein said 

annotation data comprises said word and/or phoneme data. 

71. A method according to claim 70, wherein said 
annotation data defines a phoneme and word lattice. 

0 

72. A method for searching a database comprising a 
plurality of annotations which include annotation data, 
the method comprising the steps of: 

receiving an audio input query representative of 
5 audio signals generated by a plurality of audio sources; 



a method according to any of claims 3 8 to 61 for 
determining parameter values that are representative of 
the signals generated by at least one of said sources; 
and 

comparing data . representative of said determined 
parameter values with the annotation data of one or more 
of said annotations o 



73. A method according to claim 72 , wherein said audio 
query comprises speech ^ end wherein the method 
further comprises the step of using a speech recognition 
system to process the speech data to identify words 
and/or phoneme data for the speech data? wherein said 
annotation data comprises word and/or phoneme data and 
wherein said comparing step compares said word and/or 
phoneme data of said query with said word and/or phoneme 
data of said annotation. 

74. A signal processing method comprising the steps ofs 
using one or more receivers to receive a set of 

signal values representative of a plurality of signals 
generated by a respective plurality of signal sources as 
modified by a respective transmission channel between 
each source and the or each receiver; 

storing data defining a predetermined function 
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derived from a predetermined signal model which includes 
a plurality of first parts each associated with a 
respective one of said signal sources and each having a 
set of parameters which models the corresponding source 
and a plurality of . second parts each for modelling a 
respective one of said transmission channels between said 
sources and said one or more receiving means, each second 
part having a respective set of parameters which models 
the corresponding channel, said function being in terms 
of said parameters and generating, for a given set of 
received signal values, a probability density function 
which defines, for a given set of parameters, the 
probability that the predetermined signal model has those 
parameter values, given that the signal model is assumed 
to have generated the received set of signal values; 

applying said set of received signal values to said 
function; 

processing said function with those values applied 
to derive samples of the parameters associated with at 
least one of said first parts from said probability 
density function; and 

analysing at least some of said derived samples to 
determine values of said parameters of said at least one 
first part, that are representative of the signal 
generated by the source corresponding to said at least 



one first part before it was modified by the 
corresponding transmission channel « 

75 o A storage medium storing processor implementable 
instructions for controlling a processor to implement the 
method of any one of claims 38 to 74, 

76. A processor implementable instructions for 
controlling a processor to implement the method of any 
one of claims 3 R to 74. 



ABSTRACT 



SIGNAL PROCESSING SYSTEM 



A signal processing system is provided which includes one 
or more receivers for receiving signals generated by a 
plurality of signal sources- The system has a memory for 
storing a predetermined function which gives , for a set 
of input signal values, a probability density for 
parameters of a respective signal model which is assumed 
to have generated the signals in the received signal 
values. The system applies a set of received signal 
values to the stored function to generate the probability 
density function and then draws samples from it. The 
system then analyses the drawn samples to determine 
parameter values representative of the signal from at 
least one of the sources. 
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